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X,  IllTRODCCTION 

From  the  industrial  point  of  view,  the  efficient  selection  of 
personnel  becomes  increasingly  more  important  as  the  complexity  of  the 
job  increases.  Mistakes  made  in  the  selection  of  ponch  press  operators 
are  such  lees  costly  and  easier  to  correct  than  mistakes  made  in  the 
selection  of  vice  presidents 0 A somewhat  similar  situation  exists  in 
the  field  of  education,,  The  selection  of  the  wrong  candidates  for 
specialised  training  is  costly,  in  terms  of  time  and  effort  wasted, 
both  to  the  student  and  to  the  institution  whose  facilities  and  staff 
are  limited. 

One  area  in  which  the  selection  of  personnel  capable  of  success 
on  the  job  is  extremely  critical  at  both  the  college  level  and  in  the 
field  is  the  area  of  machine  design,.  Able  designers  are  few,  and, 
especially  in  times  of  national  emergency,  there  ie  an  urgent  demand  for 
their  skills.  In  such  a situation,  even  slight  improvements  in  the 
prediction  of  success  on  the  job  or  in  training  may  yield  substantial 
dividends  in  terms  of  types,  numbers,  and  quality  of  products  developed. 

Therefore,  the  problem  of  identifying  creative  to7 eat  in  this  area 
has  been  an  important  ono  for  those  who  wish  to  select  engineers  already 
in  the  field  as  well  as  for  educators  whose  interest?  lie  in  the  develop- 
ment of  future  do signer s0 

The  problem  for  the  present  study,  then,,  ie  to  develop  instruments 
with  which  to  identify  creative  machine  design  ability.  The  investi- 
gation Is  primarily  concerned  with  making  this  identification  at  the 
Industrial  level,  but  an  attempt  to  predict  creative  ability  at  the 
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time  individuals  'begin  specialized  engineering  courses  in  college 
(usually  the  Middle  of  the  third  year)  is  also  "being  mads0 

Previous  investigations  in  this  area  have  "bean  very  limited,.  Some 
progress  has  been  made  by  Guilford  (2),  in  the  factoring  of  tests 
assumed  to  measure  reasoning  ability.  However,  no  validation  of  these 
tests  hae  been  undertaken  to  date.  Until  ouch  validation  is  done  on 
a sample  of  machine  designers s nothing  can  be  inferred  about  the  extent 
to  which  creativity  in  machine  design  may  be  predicted  from  these  tests. 

Perhaps  the  most  elaborate  system  for  selection  of  prospective 
creative  designers  used  in  industry  is  the  technique  employed  by  the 
General  Electric  Corporation  (5)o  A serien  cf  tosts,  interviews  and 
job  assignments 0 as  well  as  college  gradeo  are  used  to  evaluate  candi° 
dates  for  G.E.'s  Creative  Engineering  Progra)'.  Executives  in  charge  of 
selection  for  this  program  seam  well  satisfied  with  the  system,  but 
again,  the  lack  of  validity  data  mates  it  difficult  to  obtain  an  objec- 
tive evaluation  of  the  instruments  used. 

One  fact  which  emerges  from  the  review  of  the  available  literature 
in  the  area  is  that  the  definition  of  creative  ability  differs  somewhat 
among  different  investigators.  Also,  "creativity" 0 in  the  technical 
sense,  is  not  always  the  same  as  "creativity"  used  by  the  layman. 
Therefore,  in  order  to  avoid  confusion  of  terms , the  following  defini- 
tions for  creative  end  non*- creative  designers  were  adopted  for  purposes 
of  this  study* 

Creative  designers:  Persons  who  have  demonstrated  the  ability  to 
comprehend  the  nature  of  a design  problem,  and  to  produce  a zxovol, 
ingenious,  or  original  solution  in  the  form  of  a total,  functional,, 
and  practical  mechanism.  Creativity,  in  this  sense,  does  not 
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necesearily  involve  the  conception  of  an  entirely  rev  principle,, 

■feat  does  involve  the  combination  of  existing  principles  or  mechan- 
isms in  such  a way  as  to  produce  a new  and  unique*  solution  to  a 
previously  unsolved  problem. 

Non-creative  designers:  Persona  whose  aajor  function  is  to  work 

out  the  details  of  a design;  that  ie e vhe  engineers  who  do  not 
produce  original  ideas,  but  who  work  out  the  routine  problems  of 
what  materials  to  uso,  and  who  smooth  out  tho  do3ign  according  to 
established  procedures,, 

To  obtain  more  suggestions  about  tho  types  o?  tecta  which  might 
be  useful  in  predicting  creative  ability,  persons  in  charge  of  design 
departments  in  which  creative  individuals  were  employed  ware  asked  fer 
their  opinions  concerning  the  characteristics  of  crcativo  engineers. 

On  the  baai3  of  these  euggaations  and  the  previous  studies  in  this  a rea:. 
four  major  assumptions  were  adopted  as  guiding  principles  for  tre  ccn<= 
-traction  of  testing  instruments, 

First 0 it  was  assumed  that  in  order  to  maintain  a position  as  a 
machine  designer,  cither  creative  or  non-crcative,  an  individual  must 
possess  a certain  minirsun  amount  of  garter al  intellectual  ability ,,  It 
was  further  assumed  that  this  minimum  was  considerably  higher  than  what 
is  generally  termed  "average  intelligence1*.  Fox'  this  reason,  any  attempt 
to  discriminate  between  creative  and  non-ere ativo  daeigners  on  the  basic 
of  scores  on  standard  intelligence  tests  would  probably  not  prove 
fruitful. 

A second  major  assumption  was  that  a mere  accurate  measurement  of 
creativity  could  be  obtained  by  evaluating  something  which  an  Individual 
has  produced  instead  of  attempting  to  score  judgments  which  he  has  sado 
about  something  produced  by  another,  To  this  end,  completion  type 
rather  than  recognition  type  tseta  were  constructed. 


- 4 ~ 


The  third  assumption  made  vac  that  differences  in  age,  experience, 
and  formal  triiningo  apart  from  differences  in  creative  ability,  might 
produce  differences  in  test  scores  between  tie  criterion  groups „ To 
prevent  the  tests  from  becoming  mere  measure?  of  time  and  training,  the 
criterion  groups  were  matched  an  nearly  as  p is cable  with  respect  to 
these  three  variables,  and  analyses  were  porfonaed  to  determine  how 
well  the  matching  had  boon  donec 

Finally,  sines  the  "specificity"  or  "generality"  of  creativity  ia 
unknown,  it  was  assumed  that  the  trait  is  specific  to  a e;ive-n  e.rsa0 


This  is  net  to 
creativity  in 
of  endeavor o 


cay  that  only  engineers  can  bo  creative,  but  rather,  that 
engineering  is  different  from  creativity  in  other  fields 
On  the  basis  of  this  assumption 8 problems  dealing  with 


machine  design  rather  than  with  "general  creativity"  were  dcvolcrpedc 


XI.  METHOD 


A„  Tests  Constructed 

With  the  aforementioned  assumptions  as  points  of  reference „ six 
special  ability  tests  and  a personality  test,  vere  constructed.  All 
special  ability  tests  vere  administered  to  college  students  to  obtain 
an  estimate  of  itom  difficulty  and  time  necooBory  for  administration,, 

Items  which  proved  extremely  difficult  at  the  college  level  vere  dis- 
carded, and  tvo  experimental  test  batteries  vere  anoenbled  from  the 
remaining  items.  Battery  A consisted  of  three  special  ability  tests 
and  a personality  test.  These  were: 

Mechanical  Ingenuity „ Power  Source  Apparatus  Test 
Three  Dimensional  Space  Halations  Tost 
Figure  Matrices  Test 
Personal  Inventory- 

Battery  B was  composed  of  the  following  special  ability  tests: 

Mechanical  Ingenuity,  Design  A Machine  Test 
Humber  Series  Tost 

Unstructured  Test  for  Creativity  in  Machine  Design 
A type  of  biographical  information  blarJr,  the  Personal  History  Porn, 
was  also  included  with  both  test  batteries. 

B0  Selection  of  Item  Analysis  Sample 

Industrial  firms  vere  contacted  by  mail  and  asked  if  they  had  groups 
of  creative  and  son-creative  engineers  in  their  employment.  The  previously 


stated  definitions  of  creative  and  non-crest ivo  engineers  were  included 


an  the  letters  >( 


If  such  individuals  vero  employed  by  those  companies,,  and  if  the 
companies  vers  willing  to  allow  their  ongineera  to  bo  tested,  tney  were 
instructed  to  havo  an  executive  in  charge  of  the  engineers  ^usually  the 


chief  engine ft r ) identify  those  persons  who  could  bo  considered  creative 
according  to  the  definition c fe»nd  to  select  a like  ^mbor  of  non 'Creative 
engineers,  matching  the  two  groups  o.s  nearly  as  possible  with  rsepoct 
to  ago,  amount  of  education,  and  amount  of  experience  in  the  fieldo 
Subsequent  t tests  between  the  critsrics.  greups  on  these  vavia.bl.fi  3 
yielded  no  differences  which  were  signifies-iat  at  the  5^  level  of  confix 
donee o 

Sixteen  companies,  contributing  a total  of  1156  enginesrs,  sgr3ed 
to  cooperate  in  the  ntucy,  During  a two-mouth  period;  Buttery  A was 
administered  to  nine  of  the  participating  CC  JUV/Ct/l  ies.,  contributing  a 


total  of  70  sen,  and  battery  B v&s  administered  to  the  seven  remaining 
companies s providing  a total  of  66  nan.,  fho  types  of  firms  tested  with 


Battery  A included  a ooarpany  producing  metal  containers;  a printing 
press  corporation,  a firm  producing  varthing  vaohinss . a hydraulic  appli- 
ance company s a X2?.chiue  tool  plant.,  a firm  which  naiiufacturea  controls  for 
»sac shins  tools.,  and  two  tractor  manufacturing  conpanioc a Battery  B was 
admiidntered  to  engineers  at  an  iron  works 9 a brake  end  clutch  company,, 
a hydraulic  appliance  firm,  a corcipauy  mnufacturing  electric  po-’cr  lin« 
oquipaont;  a tractor  works.  a machine  tool  plant,  and  a company  vb.ich 
maksa  parts  fer  jet  engines  0 


Cc  Scoring 


Scoring  on  the  Three  Dimensional  Space  Relations  Test  (3-D)t,  tbs 
Figaro  Katriceo  Tost  (FM)0  and  the  Kuraber  Se  rioa  Sect  (~S)  cons Intel 
siarply  of  narking  it  esc  as  correct  cr  incorrect  on  the  basis  of  a pra« 
▼icusly  constructed  scoring  key0  In  addition,,  a p::.rt  score  was  obtained 
for  the  i*c:2S  f.n  the  3«D  teat0  Since  the  answers  iuveived  thy  correct 
identification  of  thr« ;©  sidaa  of  a cabs,  each  side  ao  s corod  ay  correct 
or  incorrect P The  nature  of  the  remaining  tests  vc ,3  cash  that  no  scoring 
key  could  be  depicted  bsforohando  Bather,  a list  of  possible  scoring 
methods  was  coup  lied  for  each  of  these  testa  , 

Items  in  the  Mechanical  Ingenuity,  5 ever  Source  X-pa rates  r'cct 
(P3A).  and  the  Mechanical  Ingenuity Design  a ifcchins  Test  (314)  wars 
asamlasd  for  total  tardier  of  solutions  givon  > In  edditions  the  solutions 
given  were  claes  i.Tisd  as  workable  or  not  worlcfblo  by  two  Independent 
judges o yer  iLs  PSA  test,  the  per  cent  of  ajyreovu-ar.f  between  jurlg.?a  on 
solutions  for  individual  items  ranged  free  6i>£  to  87$„  with  a eo-vt.  of 
7<$„  For  the  155  test,,  inter  judge  agraeKont  ranged  from  «$9£  to  9-$  for 
individual  I tens , with  a raan  of  3;-$0 

The  Unstructured  Test,  (Unstr)*  ms  scored  for  total.  muul-ar  of 
objects  identified,  scuabor  of  responses  per  wlr-nta  jsuabar  of  responses 
involving  aoticn  of  the  objects  seen,  average  nciaber  of  lino  sepaants 
used  in  each  response,  number  of  teachings/  identified,  and  par  cc-rri  of 
tsachino  responses 

Items  in  the  Personal  Invontory  (PX)  were  of  tho  paired  stc.ter-ient 
forced-choice  1;ypss  t he  scoring  of  which  could  not  be  pradetwrtsiiiod0 
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las  toad  9 er.  analysis  v/ae  performed#  as  described  below,.  For  the  items 
that  die c.r ini nated  st^nif icantly  between  the  criterion  grouos  „ a scoring 
itey  was  dotevnined  such  that  for  each  item,  the  response  moro  character' 
is  tic  of  the  creative  group  was  identified  as  the  correct  " 


rofloonse 
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III.  ANALYSIS  OP  THE  DATA 


Ac  I ten.  Dicer 

As  in  scoring  3 the  nature  of  tlio  it  ear  :..s  well  as  tie  raunber  of 
available  methods  of  analysis  dictated  the  procedure  for  determining; 
how  well  each  item  differentiated  between  the  creative  aid  the  non- 
creative  groups 0 i’or  all  tests  of  item  d i sen i m i nr. « i 0 a 9 subjects  from 
ail  companies  were  pooled , and  tested  ac  a single  camels j 

Table  1 shows  the  tests p scored  as  indicated,  which  were  analysed 
by  means  of  the  H test  (4).  a test  of  the  si;pvif  icanco  c f thy  difference 
between  rankc,  to  determine  if  e a-iy.  rifle ?.  difference  evicted  between 
the  creative  and  non-creative  groups* 

Table  1 

Tacts  and  Scoring  'fetliodsj 
Items  Analysed  by  Moans  cf  the  JI  Toss 


I.V 


Scor in e do shod 


F3A  Total  muiber  of  solutions 

PSA  limber  of  workab ie  foTuticuo 

DM  Total  number  of  so devious 

jilt  Humber  of  workable  solutions 

IJnstr  o Total  number  of  responses 

unstr  „ Ifumbor  of  line  segments  per  renpono© 

The  tests  for  which  contingency  tables  were  ret  up  to  test  for  dxf Ter- 
ences between  the  criterion  groups  are  shown  in  Table  2,  If. rally,  the 
part-  sccr-3  and  the  whole  score  for  the  JO  tost  lt*u<s  wc"e  used  no 
predictors  in  discriminate  functions  in  an  attempt  to  predict  the 


creative,,  no  n^ereat ive  criterion.. 


Tests  Analysed  by  Ksana  of  Coniingency  Tables 


Tests  Scoring  Method  #-  Rovs  X # Go'kwas  Bo?.-de:?  Glc.ssi:ficatioao 


Unctro  Kotion  Responses 


Dnstr,.,  Bats  of  Responding 


TO 


2 X 2 


2 52 


creatine,,  non^creative 
. action,,-  non<=QOtior* 

creative*  0 non—jreaiive 
ai>!«te  1„  aim&e  20 
ais-ttS©  30  misuSs  V 

cj'sstr?Q0  aoa-ore&tirc 
right „ left  *" 

creative  0 nosier  eat  ive 
right,,  wrong 


! 

■a  « : 


: ^ ' ~ 
•j ' 


2 X 2 . "T/"  " -cs©aii^9-vfflto=5re6tive-' 

- *cr-'  J 0 u~ -ci 

•,><...’/  ^ : ■.  - th^ee  aides  eor?sctu 

loss  than  three  -sides  j;  ^ 'h 

*]V  • ■'  •' ' \ eorr edt.  ' ’ 


B0  Testa  for  Gcffiraeny  Jifi  eet« 


In  addition  to  ascertaining  whether  or  not.  the.  test-  items  .discrla®  :? 

■ '■-■■  ' ■ ■-■ 

inated  betwsan  nrsfti-ire  and  nos-=c::sative  ecg£a8sfc,30  each  item  _was 

analysed  t>-  de-vesrr.ins  wopt^r-responses  differed  significantly  aaoeg  ths 
vsrions  oeairpaiiies  tested-,  Tvo  con^.ny  offsets  were  tsstsd,, 

lo  Cempany  effect  1,-,  S’c-r  this  tost  0 the  following  question  was 
asked  alseat-  each,  itess.j  iee  thora  eoasanisa  that  aro  contributing  more 


or  fewer  correct  rsjpom^s^t  or  ether  rG^onss  sassure,  -i^ponding ‘upsa 
the  Hccring'msthod  -used)  than  \ would  be  aapoc-iod  from  the  naabor  of  people 
in  that  compares  regardless  of  the  classification  ef  these  people  with. 
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respect  to  the  criterion?  To  answer  t.Mr.  question#  a goodness  of  fit 
Chi  square  was  obtained,  for  each  itom#  with  the  number  of  responses  by 
each  company  as  contributing  eleconts0 

20  Cownapy*-  affect  3„  for  those  items  which  differentiated  between 
groups  when  individuals  from  all  companies  vroro  lumped  together,  the 
following  question  was  asked:  Is  the  proportion  of  correct  rosponoeo 

(cr  other  response  measure#  depending  upon  tie  scoring  mot  hod  used) 
made  by  tha  creative  individuals  independent  of  classification  zy 
company?  Tha  answer  to  thi3  qusetion  was  provided  by  obtaining  j X 2 
Chi  squares  with  the  proportion  cf  correct  responses  by  criterion 
groups  for  each  company  as  contributing  c 1cm ants*  Snodecor'f3  co2pruta«» 
tional  method  (6)  was  employed  to  obtain  these  Chi  squares' 0 

C0  Reliability 


Odd-=evpn  correlations  s corrocted  by  the  Spoors an- *Rr own  formula  for 
a test  twice  the  length  of  the  halves,  were  obtained  on  all  testa  which 
werG  to  bo  included  in  the  revised  battery 0 The  information,  frerr.  the 
Personal  History  Fona  was  such  that  it  was  inp  .^iblo  to  conrpnts 
equivalent  halves  reliability  coofficientsc 

T>  Vi.  _ T*«  A/»1 

i/„  itiUCl  i/lll  ICUJLitf 


The  percentage  of  subjects  answering  correctly  vraa  computed  for 
all  iVZmBQ  In  the  case  of  a scoring  method  involving  number  of  'responses 
as  the  measure  used#  the  mean  number  of  i-esponsos  per  item  served  as  the 
index  of  difficulty « In  such  canos  nothing  could  bo  inferred  about  tho 
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absolute  difficult.,”-  c?  the  itcae  "hit  an  estivate  of  the  difficulty  of  &. 
^i von  item  as  compared  to  another  iten  could  ha  made  v 

,S„  latoreorrelat  ions 


For  purposes  of  determining  whether  or  nut  additional  items  should 
i-e  included  in  t.hs  revised  ba ttory , ar.  ostiu.ite  of  the  6 egrse  of  aaaoRia*. 
tion  ber/.  .’sen  items  was  obtained  c.  The  prccwu'tue  of  inter cor re!  at  irg 
every  item  with  every  other  item  vjs.8  not  followed  far  eevoral  reasons 0 
Since  all  iters  ho.d  esau  selected  on  the  bmv.s  of  the  in  relationship 
with  the  criterion.  any  sop sure  cf  association  be *••::;  or.  items  weald  he 
spuriously  hv;L«  Ihirihor,  itecc  *,  -:ro  select  rl  Ivor.  two  different 
batteries  of  test-?  which  vers  administered  to  different  samples  of 
cabjeotSo  it  v;as  thovsfor-s  inpcssi'olo  to  ivr.or  correlate  itocis  which 
were  not  common  to  a -riven  battery*  Jinrlly  , me  estimate  cf  ite.y 
reliability  could  na  obtains  6.  from  the  ava^l'  blc  data-  but  it  slight  be 
ejected  that  individual  it sm  reliabilities  would  It-  fairly  lov,  With 
lew  item  yeliabilifc5.es:.  limiting  the  magnitude  of  ti  correlations  between 
items „ an  accurate  eotir.ato  of  inter  «4fcer.  aurociaiior,  weald  have  been 
very  difficult  if  x.ct  impossible  to  obtain* 

Considering  tbo  above  restriction*  oc t:.:s?.4o3  of  association  were 
obtained  among  items  cr»  individual  tests  of  ;h&  same  battery 0 Ho 
correlations  between  items  on  different  tests,  wore  attempted*  H<:wsvo?0 
total  scores  based  or.  the  number  cf  discr imimtisg  items  answered 
correctly  were  inhere crrslafccd  for  tests  within  a given  battery,-. 
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Tests  for  which  item  iniereorrelations  <fere  obtained  were  too  PSA0 
DM0  Unatrco  aad  PI©  (Por  the  PI,  intercorreiations  were  obtained  only 
on  items  discrimi eating'  at  the  o10  level  or  better a)  Total  score 
intercorrelationa  were  obtained  between  PSA  and  PIS  and  bstwesn  Unstr0 
and  EM. 

Product-moment  correlations  were  rood  in  all  ca oas  except  for  the 
intercorrelations  aaior^  items  of  the  PI0  Those  items  were  such  ‘fiat 
the  Phi  coefficient  vra3  a more  appropriate  measure  of  association.. 


RE-StJISS 


I 

-r^O 


(V  U via 


Die  Crispins t*i  07i 


The  criterion  for  the  selection  of  an  item  to  be  tisied  in  th® 
revised  “battery  was  that  the  null  hypothesis  of  ac  difference  between 
the  neaas  of  tbs  creative  and  ncr,=creative  papulations  “be  redacted  at 
the  ,20  level  of  confidence  or  "bettor,;  in  addition,,  for  each  test,  the 
CS  described  by  Broaek  and  ‘eiede  (1)  was  nsei  to  detensino^vhether  the 
number  of  items  in  that  test  which  were  significant  at  the  ,20  confi« 
der.ee  level  or  better  was  greater  than  could  have  loan  expected  by 
chance  alone.,  Sable  3 shows  the  malar  of  items  which  ware  chosen 
from  each  test  for  farther  validation,,  according  tc  the  above  criteria, 

..  . • • - Table  3 

Bomber  of  Items  „ by  Tests  and  Scoring  Methods 0 
Selected  for  Validation 


Tost 

Scoring  Method 

50o  of  It SEC 

CR 

p 

PSA 

Total  r.Oc  of  sol1 3 

7 

2,5 

,0062 

PSA 

Ho,  workable  sol“c 

- - 6 

2,0 

c 022.7 

P_T 

''  N asat<i 

';0 

3o?0 

,0001 

Unsir , 

Ho,  of  responses 

6 

o f\£ 
<Z0  UCf 

- o0197 

W 

Total  no,  of  go13s 

4 

1*65 

o0495 

m 

Ho,  workable  sol^s 

2 

loll 

oX357 

In  addition.,  gob©  ton  arses  from  the  Personal  History  Form  wore  found  is 
discriminate  between  the  criterion  groups,  and  have  been  included  in  the 
revised  battery. 
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B„  Company  Effects 

Tests  for  company  effoctB  showed  that  tie  items  which  had  "boon 
chased  from  the  PSA  and  DM  teste  were  free  f:rcm  both  conoany  offset  A 
and  company  effect  B0  Two  Items  of  the  FI,  and  three  items  fron  the 
Unatr0  test  were  found  to  have  a significant  company  offset  A,  All  items 
except  one  from  the  Personal  History  Form  Were  free  from  company  affect  B0 

Since  company  effect  A is  primarily  concerned  with  the  relationship 
between  companies,  without  concern  for  the  classification  of  engineers 
within  those  companies  * it  wo  a Id  seen  that  a significant  company  effect 
A might  to  important  in  determining  tho  norms  lor  a given  tent  or  test 
item  for  a specific  company.  However,  if  all  subjects  in  3oue  companioB 
had  higher  scores  than  all  subjects  in  other  companies,  this  would  not 
imply  that  a given  item  was  discriminating  tatween  the  criterion  groups 
in  ons  company  to  a greater  extent  than  in  another  company,  For  this 
reason,  no  item  was  eliminated  merely  because  it  was  found  to  hr to  a 
significant  company  effect  A0 

On  the  other  hand,  a significant  comp an1'  effect  £ would  indicate 
that  the  proportion  of  correct  answers  given  by  a particular  criterion 
group  was  dependent  upon  the  company  from  which  this  groan  was  iakan- 
Thereforo,  it  would  bo  inferred  that  an  item  with  a significant  company 
effect  B was  not  discriminating  equally  well  in  all  companies.  If  this 
were  ths  case,  it  would  be  justifiable  to  include  such  an  item  if  the 
final  battery  were  to  be  used  only  in  thc30  companies  where  ths  item 
discriminated  wo  11  between  the  criterion  groupSo  Since  this  was  not  to 
bo  the  purpose  of  the  final  battery,  the  ana  item  which  hud  a eignifi- 
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cant  company  effect  B was  excluded* 


C0  Reliability 


The  reliability  coefficients  obtain;.!  are  shown  in  Table  4C 


Table  4 

Reliabilities  of  Reviesi  Tests 


Test 

Corrected  r 

PI 

062 

o?7 

PSA 

.in 

o ro 

088 

EH 

» 75 

«86 

Unstr0 

089 

.,94 

Aa  in  the  case  of  item  intercorrelations 0 th339  rcs  E3y  be  somewhat 
spuriously  high.,  since  they  were  obtained  us  ing  only  those  items  which 
discriminated  between  tha  criterion  groups „ However a it  would,  appear 
that  these  correlations  are  high  enough  to  justify  further  testing 
without  the  construction  of  no u it era  moroly  to  increase  toot  relia- 
bility,. 


D0  ItOm  Difficulty 


The  item  difficulty  indices  generally  ranged  around  ^50,  with  the 
exceptions  of  ite;ao  at  the  beginning  and  on-  of  the  3 D and  !?K  i 2ste0 
Items  at  tho  ends  of  these  two  testa  appeared  extremely  difficult, 
because  most  of  tho  subjects  did  not  have  an  opportunity  to  at.trinpt 
then  zzt  the  tico  allowed*  Even  though  ti.o  amount  of  information  was 
limited  on  ouch  items,  they  wore  not  included  in  tha  revised  but. tory0 


- ly  — 


since  uitli  both  tests,  a large  number  of  items  which  had  boon  attempted 
by  nearly  all  JSs  did  not  differentiate  between  the  criterion  groups 0 

S0  Intercorrelation3 

Phi  coefficients  between  discriminating  items  on  the  PI  are  shown 
in  Table  5o  -As  previously  mentioned,  the  item  intercorrelations  for  the 
PI  included  only  items  discriminating  at  the  a10  le\rei0  The  corrected 
reliability  coefficient  for  the  PI,  including  those  items  discriminating 
at  the  o20  level,,  was  0?7t  which  would  suggest  that  the  item  reliabiii° 
ties  arc  quite  lov3  This  ia  not  uncommon  for  psrsonality  items,,  It 
would  seem  reasonable  that  those  item  discriminating  at  loss  than  the 
o10  level  may  h&va  done  so  at  least  partially  because  of  lower  atom 
reliability o If  this  vers  the  case,  it  would  bo  expected  that  item 
intercorrelations  baaed  on  those  items  would  be  spuriously  low,,  and  so 
low  aa  to  obviate  any  inferences  from  them,  concerning  the  construction 
of  new  items 0 

Prom  Table  5 it  is  appa  rent  that  the  item  iatercorrelationa  for 
the  PIe  even  among  the  items  discriminating  at  the  ,>10  level  or  bettor „ 
were  quite  low0  If  items  on  the  PI  are  measuring  soveral  distimt 
personality  traits  associated  with  creativity „ tb.3  number  of  ite:n.s  which 
measure  each  trait  was  extremely  small  on  the  experimental  «»wut0  uiid 
should  be  increased  on  the  revised  test,,  However,  with  the  information 
which  is  available  at  present,  it  is  not  possible  to  say,  with  any 
degree  of  certainty,  that  unique  factors  are  being  jaGscurod  by  items  on 


this  tost  „ In  view  of  these  facte,  a compromise  solution  >••??  rcnchad. 


Item  Intercorrelfctiona : Personality  Inventory 

(Items  Sfyjnif leant  at  the  .10  Level  or  Better) 
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Items  milch  diccrin'.in-'.tod  at  tho  .20  level  wore  inelucec  in  tt.o  rovioed 
tost*  but  iio  new  items  were  constructed,, 

Intevcorre'lBuiont  among  ites3  on  ?L>J  are  nbown  lv  fable  *:  . iaoro 
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19  Uv"OOw 

st  tu: 
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2ly  - 
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were 

items  9 
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be  aado 

to 

cons  trv. 

O v </  J.i 

w or . v;i:..:u  it  erf:  flits  vu  i» 

rility  was  *iy 


ffablo  7 shown  the  asaoetatierts  between  the  die cr  luli-atine  lie-ins 
from  3i‘i0  Vhile  the  correlations  c-btainsc.  arc  somewhat  ..;rcr  tier,  these 
i'er  PSa„  no  additional  I'H  items  have  beer-  constricted  i;c  dat!S9  sir.ee  the 
structure  and  content  of  the  DM  iters  clceoly  rossiBbles  that  of  P£A«  It 
in  expected  that  it  sec  from  the  bo  two  teat  3 rill  bo  ;-.t  least  nodes  steljr 
correlated  when  it  5s  possible  to  Balsa  comparisons  lelvcon  tho;.:0  If 
such  is  net  the  car e - c dditional  Ell  items  will  bo  buili-o 

Iater«-itum  correlations  for  tho  Unctr,  tost  arv  nnown  la  Pablo  g . 
All  diBcrifiEhtiss  items  on  this  test  were  fairly  highly  intcvco-4 related 


end  total  score  reliability  was  tho  highest  obtained  for  my 


3 .,  1 *c::-: 


Thee...  rconltc  no  new  itezn  c o ~,.5 1 m g 1 r o a cMiOmtsu.  w z- r.-’.- r • - jx*  c-xris  .' o 3 v.  .■ 

Por  total  score  intarcorrelat:  ous » all  itOBC  vm  .cb  disoriniaatod  at 
the  v20  level  or  better  were  usod  in'  each  cs.se  „ ‘Chose  ccrrelaticno  are 
shown  in  Sable  9„  ’fin  amount  of  ascociation  bo  tween  the  zests  rn. 

D-  i.txn-y  A was  slightly  greater  than  in  Battery  £»  Kcwavar.  naici-wr  of 
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these  correlations  was  high  enough  to  Notify  the  car.uii.&tion  or  flel-ation 
of  tests  from  the  revised  ’bsttery.. 

In  general  at  bo  ssid  that  the  results  of  the  treasure  of 

association  obtained  .anon g discriminating  it 3ms  on  the  several  tents 
vrere  sonewbat  •-•cptricled*  both  by  item  unreliability „ arcl  by  ah.-;  fact 
that  all  itens  were  correlated  'rich  the  criterion.  Therefore.,  the 
conclusions  drmrn  fro  ; these  results  must  be  tohvsv-.ive  ct  bss--:;r  ar.d  any 
decisions  as  to  the  construction  of  additional  iteRS  should  probably 
not  be  isade  on  tho  basis  of  those  cencinainns  alone,.  Eethor0  tacos 
intercorrelat ions  were  visaed  as  yery  rough  app? oz5."«s  t i c«s  of  the 


rolationsnipa  rnich  saint t,  and  further  itcy.  construe*.?.  nr  vk 
until  more  information  about  present  iiess  could  bo  csllocted., 


1A  'f-AA-'  •! 
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To  *p3*0EB$  PIAKS 


As  has  already  been  nser.tl. c - CH,  erxaTigeirsntE  have  been  issue  to  test 
a sample  of  mechanical  engineer  ' i-~  *app.-3rclasi  men  in  three  advanced 
engineering  courses  <>  iiuaiwcts  wljU.  bo  giwpn  all  of  the  ravisod  tests, 
and  item  intercorrelatioas  -ill  \&  obtains*!.  0 In  additions  two  of  tbs 

• . _ ; ‘ -i  2 

classes  to  be  tested  will  be  sectors  of  courses  dealing  with  machine 

. ; - , ■'  •*'•>  c \ : ; . ; 

and.  aachine  elesisnt  dcsigUo  For.  tsu  besets  in  these  sect  ions ^ an  inters 

■ < i •'  . %'  :"j  : 'l  ' • / 

mediate  criterion,,  consisting.  of  cJLasaificRi-ion-'by  the,;  section  inatraypt^' 
will  be  available  la  the  near  f*%s?e0  With  this  information,-  aa  -asti-  <f . 
sate  of  the  predictive  officiate?  of  iho  revised  testa  fit  the  college 
level  may  ba  obtained^  • ^ . 

druse  intorcorfeiati. --nd  sibo^  'All  items  ire  available,  the  finslhr^ 
test  battery  will fVa  .absastbledo ; Items  will  bs.  consthucved  ; 
if  unique  factors  appear,  Or  sot?)  toEKclidatioa  insy  be  rr&do  If  inters 
correlations  stye  Mgshc" -•  ^Snal ."  bsHs-ry 5 s 'validation  £udy- _ 

will  be  tridertakeiic  Inmistr5.ee  now  - being,  contacted.  ~to“Offev&iii.  tba 
subjects  necessary  for  this-  -study  ^ 

-further  werfc  will  be  eontllwj^vs-  upon  the  validity  of  the  revised 
battery;,  If  a highly  valid  bsttsrey-  of  tests  is  obtained . the  nsjtt  step 

tvim-il  a 1/M»4Aon-<r  Th*v ~ rv^  0^a»rt«s  ‘“•flCs-iiTnTfflO'nf.a  rww  fj 

sample  of  engineer  t ; firm  roany  di^fyyarit  iKous tries , and  in  various 
geographical  loeatiohSo  .If-  the  Yshli&ity  of  the  battery  is  too  lew  for 
satisfactory  prediction,,  new  tasl,#3  nay  be  constructed  in  the  hcoe  that 
other  aero  fruitful  aptitudes  ar4  abilities  *ay  be  sisasurodn 
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